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MEIHODS AM) APPARA.TUS FORDISPLAYIN 

CATEGORIES 

BACKGROUND OF XEffi I^rVE^mON 

[0001] The present invention generally relates to displaying multiple data 
categories^ and more particailaily to methods and apparatus for displaying multiple 
data categories. 

[0002] A display provides a visual presentation of infonnation. This 
visual presentation of infoimatLOn with a display oan include muhzple data categories. 
For example, mnltzple data categories corresponding' to sensors and systems of a 
vehicle can be visually presented to a vehicle operator with a di^lay. The rnnltiple 
d^ categories can be ssiy number of classes or divisions in a classificattoti sch^e of 
infimnation that are to be visually represented on a di^lay such as navigadbii. data 
(e.g.» Tiavig^ojx aid odrNAVAlD data, aixport data, Sx data, latecal/yertical/timd 
plan route data, commumcstipn fiequency data, latitude and longitude data, Grid 
Mxnmuim Off-Rout^ i\lfitude (Qrid MORA) data, aiir'ti^^^EBc cratrbl and bcnsi^^ 
data, magnetic variation data, time zone data, ipprpach and deparfure chait; data, 
aixport diagram data, dly data, road data, raihoad data, elevation contour line .data, 
river data, lake data, uplink weather data, winds aloft data, airspace data, airvmy jdata 
and. absolute tenain data, or the like) and sensor data (e.g., airborne weather, data, 
Automatio Dependeaot Smyedllance^ Broadcast (ADS-B) data, obstacle data, tiafSc 
sensor data or Traffic alert and Collisioa Avoidance System (TCAS), relative tissrain 
data and J&ihanced Otcmd Proxxmity Warning System (EGPWS) data) of an aiiurail. 

[0003] Displays have continued to advance in sophistication and have 
achieved increasmgly higher levels of ixxfozmation densi^ that ^ble the visual 
presentation of a gteater number of data categories^ which is also referred to as data 
fusion. These advancements provide die visual display of multiple data calegbriea 
that can be readily assimilated by an operator and/or user of the display and can also 
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provide a reduction in lannecessary information to ease the task of perceivjtig and 
understanding a data category of interest. However, as the information density 
continues to increase^ methods and apparatus are desirable tliat visually display the 
data categories in a manner that provides proper cogtritive mapping between the 
. operator and/or user of a display and also reduces the effort of the operator and/or 
user in assixoilating one or more of the data categories of interest 

[0004] In view^ of Hie fiTregoing, it should be appreciated that it would be 
desirable to provide an apparatus for di^Iayi^g mn^ple data categories. In addrtion^ 
it should be appreciated that it woidd be desirable to provide a method £>r displaying 
multiple data categoric. Furdiermore, additional desirable features will become 
apparent to one skilled in fbe art £:om tfie drawings, foregoing background of liie 
invention, following detailed description of a preiecred ^ceanplaiy eosbodiment and 



BRIEF SUMMARY OF THE INVENTION 

[0005] An aj>paratns and method are provided for displaying a plurality of 
data categories. The apparatus is comprised of a display that is configured to produce 
visual representations of ttie plurality of data categories and a processor &at is 
configored to control the display such, that at least one of three display modes is 
provided for the visual representations of the plurality of data categories. The &st 
display mode provided by the apparatus and method is a transparency mode for at 
least one of the visual representations of one of the data categories. The second ^ 
display mode provided by the present apparatus and method is a dynamic layering 
mode for the visual representations of tihe plurality of data categories. The third | 
di^lay mode is a color prioritization mode for at least three of the visual | 
representations of three of the data categories. One or more of these display tnodes | 
pre-edits visual representations of the plurality of data categories with the display in a | 
manner that assisis cognitiye mapping between the display and the user and/or | 
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ON 

Q (57) Abstracts Methods and apparatas are provided for displaying multiple data categories- The apparaias is comprised of a display 
2 that is configured to produce visnal representations of the plujrality of data categories and a processor that b configoied io control the 
A disptey soch thai at least one of three display modes is provided for the visual representations of the pluraJity of data categories. The 
^ fiisl display mode provided by the apparatus and method is a tmnspatency mode for at l^st one of the visual repiBsentations of one 
^ of the data categories and the second display mode provided by the apparatus end method is a dynamic layering mode for the visual 
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[0013] FIG. 7 is tte Cotomission latematiotial de rEclairage (CIE) 
Uniform Cbromaticity-SQale (UCS) of nineteen hundred and seventy-six (1976), 



DETAILED DESCRIPTrON OP A PREFERRED EXEMPLARY EMBODIMENT 

[0014J. The following detailed description of a preferred embodiment is 
merely exemplary in nature and is not intended to limit the invention of tfie 
qq>lication ^d uses of the invention. 

[0015] Refeniig to Fia 1, an apparatus 20 is illustrated for di^laying 
data eateries 22 accordiijg to a preferred exen^Iaiy embodfanent of the present 
invention. The ^paratos 20 is comprised of a display 24 that is configured to 
prodnce visual represcntationa of the data catego^ The display 24 can be any 
current and future display fiat is suitable for producing visual lepresentatibns of the 
data categories 22 and preferably a multi-color display. For example* the display 22 
can be a color Cathode Ray Tube display (CRTX monodiioitte CRT display. Liquid 
Qcystal Display (LCDX plasma display, Flat-Panel Displ^ (FPD), electro- 
luminescent display, vacmim fluorescent display,^ Hfeads-Ui* Display CBttJD), Heads- ' 
Down Display (HDD), Hehnet Mounted Display (HMD), Light Emitting Diode 
(LED) display or the like. 

[0016] In addition to the display 24^ the apparatus 20 of the present 
invention is also camprised of a processcir 26 in operable commurdcafcion with the 
display 22 to conttolfhe display 24 during production of the visual representations of 
the data categories 22. The processor 26 preferably encompasses one or more 
fhnctfonal blocks and can include any nrnnber of individual microprocessors, 
memories, stOTage devices, ihteiface cards, and oflier processor components. The 
processor 26 is configured to receive and/or access the data categories 22 and also 
communicate ^th an input device 32, which can be any device suitable for accepting 
input fiom a user 34, such as a cursor control device (e,g., touch-pad, joystick, mouse, 
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[0018] The processor 26 is configured to control the display 24 such that 
at least one of three display modes is provided for the visual representations of the 
data categories 22, The first di^lay mode is prefciably a transparency mode for at 
least one visual representation of one of the data categories 22, the second display 
mode is preferably a dynamic layering mode for at least two of the visual 
representations of two of the data, categories 22, and the third display mode is 
I?ieferably a color prioritization mode for at least three of the visual representations of 
three of the data categories 22, Que or more of these display modes presents visual . f 

tepresotitations of the data categories to the user 34 in a manner that preferably assists 
with the cognitive moping between the display 24 actd the nser 34 and/or reduces the 
time, eactor and/or effort of the user 34 in assimilating at least one data category of 
interest 



[0019] Referring to HG. Z, the display 24 is shown in the firet display 
mode (ie.» trdnspareucy mode) acctnrding to a preferred exemplaiy embodim^t of the 
present invention. In order to mftintain sin^licity and clarity in this detailed 
description pf a prefeired exeno^lary raobodimenl; the display 24 is lUnstrated wiOi 
visual representations of four data categories <x^e.» data Won of four data categories). 
More specifically^ visual representations of weather sensor data 38, airway data 40^ 
anspace datsi 42 and compass beadiDg data 44 is. produced i^y tbe display 24 under the 
control of tbe .processor 26 as shown in PIG. 1. However, any number of visual 
representations of aircraft data categories can be produced on the display and other 
data categories in other vehicle and non-vehicle ^plications can be produced on the 
displEQT 24 as previously discussed in this detailed description of a prejeued 
exemplary embodiment (e.g., data categories of other land, water^ air or space . 
veincles and non-vehicle appHcations such as simulators. Computer Aided Design 
(CAD) systems^ video games, control systems of stationary objects, medical 
diagnostic devices, weather forecasttog systems and I^top and desktop computers 



i 



55 

that utilize a disptey for visual ^:eseatatioa of data cate^odes). 
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40 and preferably the other visual representations of data categories in common 
regions of the display. The processor 26 as sho^ in PIG. 1 is also configured to 
control the display 24 of FIG. 1 for production of additional transparency levels that 
provide additional levels of transparency of the visual representation for the weather 
s^QT data 38 and additional levels of visibility for tiie airway data 40 and preferably 
the. other categories (e.g., airispace data 42 and compass heading data 44) in common 
; regions of the display. For example a second enlarged viewr 58 of the region 54 of 
Fig 2 is shown witlx the visual repiesentetion of the weather seijspr data 38 produced 
at a second transparmcy level 60 that provides a secozid level of traaspardncy of the 
viwial'rqjresentation for the weather sensor data 38, \^ch is about less than the first 
transparency level 56 and a second level of visibility of the visual representation for 
the airway data 40 that is d)out less than the first Furthermore, as 

. shown in the third enlarged view 62 of the region 54 of Fig. 2^ the visual 
rqjres^tation for the weaflifir sensor data 38 is produced at a third transparency level 
r 64 that provides a third level of transparency of the visual lepiesentaJdxm of weather 
sensor data 38 thatisajK>nttes than the second tranaparencqrlCT • 
of visibility of the visual representation fi>r airway data 40> wMch is about less flian 
the second level of visibility, hi addition^ any mimb^ of other transparency levels 
can be produced with degrees of transparency and visibility greater riian and/or less 
than the first transparency level 56, second tran^arency level 60 and thiifl 

transparency level 64. . 

r. 

[0023] Referring to FIG* 1, the first transparency level 56, second | 
transparency level 60 and third traiisparency level 64 iUustrated in FIG. 3, or some v 
othCT transparency level, is preferably selected by the user 3'4. For exaniple, the user | 
34 can select one of the tranqyafency levels (56,60,64) illustrated in FIG. 3 using any f 
rtumber of input devices in ojperable commmiication with the processor 26, such as a 
virtual control formed of the cui^or control device 32 and a grsqahical user interface 
(GUT) (not shown) generated on ttie display24, for example. Alternatively, one of the 
transparency levels (56,60,64) iUtistrated in FIG. 2, or some other transparency level, 
can be selected based upon other non-user inputs of the ^paratus 20. For example, 
the transpareacy levels (56,60,64) illustrated in FIG. 2, or some other transparCTicv 
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representatioiis of the airway data 40, airspace data 42 and compass heading data 44 

(i.e., the visual representatioii of weather sensor data 38 masks the visual ! 

I. 

representatiQas of the airway data 40> airspace data 42 and compass heading data 44 | 
in common regions of the display). The processor 26 as shown ixk FIG* 1 is also 1 
configured to provide an altered mode of the display 24 that alters the visual 
representatious of the data categories (38,40^42,44) such that at least one or more of 
the visual representations of anway data 40^ ah:$pac6 data 42 and cornpass headiiag 
data 44 is siq)6iiinposed over the wea&er sensor data 3S as shown in HG. 5 (i.e^ the 
visual representation of at least one or moie of the visual rq>res6ntatiQns of airway 
data 40* airspace data 42 and coir^ass heading data 44 masks ihe visual representation 
of the weather sensor data 38 in common regions of the display). The i^cessor 26 
as shown in FIG. 1 is cotifigured to provide the d^ult mode and altered mode based 
xtpon predefined events. 

[0026] More specifically and with continuing reference to.FIG. 4> the 
visual re{Kcesentalion of weather saoaoT data 38 is preferably siq>edniposed over the ^ 
visual representation of the airway data. 40, airspace data 42 and conq>ass Ti^<%g ^ 
data 44 in the de&ult mode of the dynamia layering mode. In this illustrative 
example^ which should not be construed as a limiting embodiment of the inventton, 
the visual r epr esentation of weather seosor data 38 is superimposed with a first colocr 
(e.g., red color) 66 for high intensity weather, a second color (e.g., yellow color) 68 . 
for intermediate intensity weather and a third color (e.g.;, green color) 70 for low 
intensity weather. The first color 66, second color 68 and ihird color 70 providmg Ihe \ 
visual representation of weather sensor data 38 substantially reduces or eliaunates the 
visibility of the one or more of the other data categories (40»42>44) in common or 
interseofing regions of the display 24 more than one of the other visual representations 1 
of data categories (40»42^44). As can, be 8ppreci.ated fi:om this description of a 
preferred exemplary embodiment of the present inveuficm, this, default mode of the | 
dynamic layering mode assists the cognitive mqyping between the display 24 and Ihe | 
user and/or reduces the time, error and/or effort, of the user in assimilattng a. data 
category of interest (ag.^ the visual representation of weather sensor data 38 as the 
data category of interest). However, the data category of interest to the user 34 can ^ 
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altered mode of the second display mode as illustiated in FIG, 5. Alternatively^ title 
processor 26 can be configured to control the display 24 in order to provide the | 
defeult mode of the second display mode as illustrated in FIG, 4 until the processor 1 
identifies a non-user inpnt For Gxmsple^ the processor 26 can be configured to | 
control the display 24 in oider to provide the defeult mode of the second display mode 
as .illustrated in FIG. 4 until the processor identtfies a predefined event in the sensor 
data 28 (e.g., relative terrain data mdicates that the distance between the aircraft and 
the terxain is less than a predefined distance) at which time the processor 26 controls 
the displ^ 24 to prcKvide the default mode of the second display mode as illustrated in 
FIG: S. Therefore^ the default mode and altered mode or altered modes of the 
dynamic layering mode can be selected by the uscsr 34 or the ^paratus 20 to provide a 
visual representation of one or more of the data categories 22 that asdsts the cognitive 
mapping between the display 24 and the user 34 and/or relduciss the time, aror and/or 
effort of the user 34 in assimilatihg at least of the data categones 22 of interest As 
pr^ously alluded m fiia brief smtimaiy of the invention and this detailed desciiption 
of a preferred exemplary emboduneni^ the dynamic layering mode can assist m the 
cognitrve mapping and data asfarciilatifm without additional display modes or with 
additional display modes^ such as the tran^arettcy mode and/or the color 
prioritization mode. 



[0029] Referring to FIGi 6, the display 24 is illustcated in the color 
prioritizatioii mode (i.e.^ third display mode) according to a preferred exemplary 
embodiment of the present invention. In order to maintain the simplicity and clarity 
in ttris detailed description of a preferred exemplary embodiment, the display 24 is 
illustrated with the visual representation of three data categories (i.e.^ data fusion of 
three data categories). More specafically, the visual representation of airway data 40, 
airspace data 42 and compass heading data 44 is produced by the display 24 under the 
control of the processor 26 as shown in FIG. 1. Howev^, as previously discussed 
with reference to the first display inode and the second display mode> any number of 
visual representations of aircraft data categories can be produced on the display 24 
and data categories in other vehicle and non-vehicle applications can be produced on 
the display 24 in accordance with the present invention (e.g., Hafa categories of other 
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diagram (1976) 76 is shown tbat presents color space of a first color (e.g., red 66)^ 
second color (e.g., green) 70 and third color (e.g., blue) 74 in terms of Imninance (Y), 
a first chroroaticiiy coordinate (u') 80 and a second chroznaticity coordinate (v^ 
where chroioaticity (u\w^ is the measure of hue and saturation, hue is related to the 
wavelength of the color and is represented by the coordinates on the CIE UCS 
diagram 76, saturation is represented by the relative distance &om the center or equal 
energy point 78 md luminance (Y) is the achromatic aspect of a color stimulus. The 
three quantities of CUE UCS color space (i*e», Y, u^ V) are used to define chromatic 
and achromatic, aspects of a color stimulus and provide a replicable desc^pdon of | 
colors. 



[0032] The three quantities of CDS UCS color space (i.e,, Y, tt\ V) are 
utilized in accordance with the present inventioTi to select the first color and fhe 
secondcolor. The first color and fbe second cx^lor for the respective data category 
selected based vpofn fhe symbol and bacl^grouud contrast recommendations of fhe 
International Organization for Standardization with ti^ | 

AE(Y,u^v0 = [(155AY/Yx™x)^+(367Au7'+(167Av')Y^ (1) 

Where the difibrential values ^.t., AY» Au* and AV) relate the differences between the 
chroroaticity (a*»v*) and luminance (Y) of two colors and is the mftylmwm i 
hnninance of the display. However^ the £bt$t color and second color for fhe respective \ 

data category can be selected based upon other considerations or reconunendations. l 

. .. • ■• I 

[00331 ^Iot fer ^ first data category having the first priority 

can be selected witii equation (1) such that the color difference (AE) between die first ^ 

color and the bacik;^uad color is preferably greato: than about seventy-fiye (75)> | 

more preferably greater than about ninety (90) and most preferably greater than aboM % 

' one hundred (100), while tite second color for the second data category having fhe ^ 

second priority oan be selected with equation (1) such that fhe color difierence (A£) I 
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' CLAIMS 

What is claimed is: ' 

1. An ^Mtus&r displaying aphirality of (kta categoric 
a display that is configured to produce a first visual representatitm of a first 
data category of the plurality of data categories and a secondvisual representation of 
said second data category of the phnaJiiy of data categories; and 

a processor that is coiifiguriBd to conliol said di^lay daring pi^^ 
fest "vifflial reptBSentadon of said first data category and said second vfaual 
representation of said second data category such ttiat said first visual representation of 
said first data category is at least partially transparent to provide at least partial 
visihility of said second visual representation of said second cate»»y fiirough said 
first visual lepresentatiop of said imit As^k c-afegory- 

2. The qjpaiatns of Claim 1, wherran said display is configured to 
produce a third visual rqwesentation of a third data category of the plurality of data 
categories and said processor is comfijgured to oontml said, display dining production 
of said first visual tepresei«ation of 'said first data category and said ftird visual f 
iqireseotation of said fiiird data cst^pry sudi that said first visual representation of 
said first data category is at least partially transpairait to provide at least partial 
visiT>ifity of siaid flrird visual representati^ limd categoiy of data flrrough'said 
first visual representation of said first data category. 

3: The ^aratus of Qaini 2, whereitt said display is ooafi^ired to 
produce a fourth visual repreSearfation of a fourth data category of the pluraKty of data 
categwies and said processor is configured to conliol said di^lay during production 
of said first wsual rqMBsentatioii of said first data category and said fourfli visual 
Hjnresentation of raid finirfh data category such that said first visual represeotation of 
said first data category is at least partially transparent to pro^de at least partial 
visibility of said fourth visual rqaesentation of said fourth data category through said 
first visual lepreseatation of said first data category. 
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10. Aq apparatus for displaying a plurality of data categories, comprising: 
a display that is configured to produce a first visual layeaf represeatatioii of a 

first data category of the plurality of data categories and a second visual layer 
representation of a second data category of said plurali^ of data categories; 

a processor that is configured to control said display to present said first visual 
representation of said first data category superimposed over said second visual 
rqnresentation of said second data category and superimpose $sid secorzd visual 
representation of said second data categoiy over said first visual representatioii of said 
first data category if apredefined event is identified by said processor. 

11. The apparatus of Claim 10, wherein said displ^ is configured to 
produce a fliird visual representation of a third data category of the pluxality of data 
categories and said processor is configured to control said display to present said first 
visual representation of said first data category superinoposed over said third visual 
r^resentation of said third data category and superimpose said Hurd visual 
representation of said thud data cat^ory over said first visual representation of said 
first data category if said predefined event is identified by said processor. 

12. The ^paratus of Claiin 11, wherein said display is configured to 
prc^ce a fourth visual representation of a four& data category of the plurality of data 
categoric and said processor is configu:red to control said display to present said first 
visual representation of said first data category superimposed over said fourth visual 
representation of said fourth data category and superimpose said fburtjbi visual 
representation of said fourth data category over said first visual representation of said 
first data category if said predefined event is identified by said processor. 



13. The apparatus of Claim 10, wherein said plurality of data categories 
are vehicle data categories. 

14. Hie apparatus of Claim 10, wherein said plurality of data categories 
are aircraft data categories. 1 

I 
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(57) Abstract: Methodi and ^paratus (20) are provided for displaying multiple data categories (22). The apparami (20) is com- 
prised of ft display (24) thai is configorcd to piodacc visual mprcscntations of theplwality of daca categories (22) and a processor (26) 
that is configured to control the display (24) such that at least one of three display modes is provided for the visoa) representations 
of the plurality of data categories C^). The (xist display mode provided by the apparatus (20) arid method is a transparency mode for 
at least one of the visxjal representations of one of the data categories (22) and the second display mode provided by the appamtcs 
(20) and method is a dynamic layering mode for the visual representations of the plurality of cfata categories (22). The thinJ display 
mode is a coJor prioritizadon mode for at least three of the visua] lepicsentations of three of the data catceories (32). One or more 
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